Encoding and Decoding Variable Length Instructions

ABSTRACT

Methods of encoding and decoding are described which use a variable number of instruction words to encode instructions from an instruction set, such that different instructions within the instruction set may be encoded using different numbers of instruction words. To encode an instruction, the bits within the instruction are re-ordered and formed into instruction words based upon their variance as determined using empirical or simulation data. The bits in the instruction words are compared to corresponding predicted values and some or all of the instruction words that match the predicted values are omitted from the encoded instruction.

BACKGROUND

The set of instructions which are executed by a processor are referredto as an instruction set and these instructions are typically mapped toinstruction words as a way of presenting the hardware controls to thesoftware. The processes of mapping instructions to instruction words andback may be referred to as encoding and decoding respectively. Codedensity may be used to compare different encoding schemes, where thecode density is inversely proportional to the memory required to storeall the encoded instructions (i.e. instruction words) used to perform aparticular task (e.g. all the encoded instructions in a particularprogram). To increase the code density, short instruction words may beused and this may, for example, be achieved by limiting thefunctionality of the instruction set. Alternatively, variable lengthinstruction words may be used, with shorter instruction words being usedfor more commonly used instructions and longer instruction words beingused for less commonly used instructions.

The embodiments described below are provided by way of example only andare not limiting of implementations which solve any or all of thedisadvantages of known methods of encoding and decoding instructionsfrom an instruction set.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

Methods of encoding and decoding are described which use a variablenumber of instruction words to encode instructions from an instructionset, such that different instructions within the instruction set may beencoded using different numbers of instruction words. To encode aninstruction, the bits within the instruction are re-ordered and formedinto instruction words based upon their variance as determined usingempirical or simulation data. The bits in the instruction words arecompared to corresponding predicted values and some or all of theinstruction words that match the predicted values are omitted from theencoded instruction.

A first aspect provides a method of encoding instructions from aninstruction set, the method comprising: receiving an instruction fromthe instruction set; re-ordering and grouping bits in the receivedinstruction into a plurality of instruction words according to anencoding type to generate an ordered sequence of instruction words;comparing bit values in one or more of the instruction words in theordered sequence to their corresponding predicted values and generatinga compressed version of the instruction by omitting one or more of theinstruction words in the ordered sequence based on the comparison,wherein the predicted values are generated using empirical and/orsimulation data; and outputting the compressed version of theinstruction.

A second aspect provides a device for encoding instructions from aninstruction set, the device comprising: a processor; and a memoryarranged to store device-executable instructions configured, whenexecuted by the processor, to cause the processor, in response toreceiving an instruction from an instruction set, to: re-order and groupbits in the received instruction into a plurality of instruction wordsaccording to an encoding type to generate an ordered sequence ofinstruction words; compare bit values in one or more of the instructionwords in the ordered sequence to their corresponding predicted values,wherein the predicted values are generated using empirical and/orsimulation data; generate a compressed version of the instruction byomitting one or more of the instruction words in the ordered sequencebased on the comparison between the bit values in one or more of theinstruction words in the ordered sequence and their correspondingpredicted values; and output the compressed version of the instruction.

A third aspect provides a method of decoding instructions comprising:receiving, in a decode stage of a processor, one or more fetchedinstruction words; determining an encoding type from one or more of thefetched instruction words; generating an ordered sequence of instructionwords by selecting, for each of the instruction words in the sequence,either a fetched instruction word or a predicted instruction word,wherein the predicted instruction words are generated using empiricaland/or simulation data; concatenating the instruction words in theordered sequence to form an encoded instruction and re-ordering bits inthe encoded instruction according to the encoding type to generate adecoded instruction; and outputting the decoded instruction.

A fourth aspect provides decoding hardware comprising: an input arrangedto receive one or more fetched instruction words; hardware logicconfigured to determine an encoding type from one or more of the fetchedinstruction words; word selection logic configured to generate anordered sequence of instruction words by selecting, for each of theinstruction words in the sequence, either a fetched instruction word ora predicted instruction word, wherein the predicted instruction wordsare generated using empirical and/or simulation data, and to concatenatethe instruction words in the ordered sequence to form an encodedinstruction; re-order hardware logic configured to re-order bits in theencoded instruction according to the encoding type to generate a decodedinstruction; and an output arranged to output the decoded instruction.

A fifth aspect provides a device for decoding instructions from aninstruction set, the device comprising: a processor; and a memoryarranged to store device executable instructions configured, whenexecuted by the processor, to cause the processor, in response toreceiving one or more fetched instruction words, to: determine anencoding type from one or more of the fetched instruction words;generate an ordered sequence of instruction words by selecting, for eachof the instruction words in the sequence, either a fetched instructionword or a predicted instruction word, wherein the predicted instructionwords are generated using empirical and/or simulation data; concatenatethe instruction words in the ordered sequence to form an encodedinstruction and re-ordering bits in the encoded instruction according tothe encoding type to generate a decoded instruction; and output thedecoded instruction.

A sixth aspect provides a method comprising: receiving, at an input,mapping data for an instruction set and instruction data describinginstructions in an instruction set in canonical form; parsing themapping data and instruction data using a grammar library; generating,in a code and data generation engine, both encoding software and ahardware description of a decoder based on the parsed mapping data andinstruction data; and outputting the encoding software and the hardwaredescription of a decoder.

A seventh aspect provides a device comprising: a processor; and a memoryarranged to store device-executable instructions configured, whenexecuted by the processor, to cause the processor, in response toreceiving mapping data for an instruction set and instruction datadescribing instructions in an instruction set in canonical form, to:parse the mapping data and instruction data using a grammar library;generate both encoding software and a hardware description of a decoderbased on the parsed mapping data and instruction data; and output theencoding software and the hardware description of a decoder.

The decoding and/or encoding apparatus described herein may be embodiedin hardware on an integrated circuit. There may be provided a method ofmanufacturing, at an integrated circuit manufacturing system, a decodingand/or encoding apparatus. There may be provided an integrated circuitdefinition dataset that, when processed in an integrated circuitmanufacturing system, configures the system to manufacture a decodingand/or encoding apparatus. There may be provided a non-transitorycomputer readable storage medium having stored thereon a computerreadable description of an integrated circuit that, when processed,causes a layout processing system to generate a circuit layoutdescription used in an integrated circuit manufacturing system tomanufacture an encoding and/or decoding apparatus.

There may be provided an integrated circuit manufacturing systemcomprising: a non-transitory computer readable storage medium havingstored thereon a computer readable integrated circuit description thatdescribes the decoding and/or encoding apparatus; a layout processingsystem configured to process the integrated circuit description so as togenerate a circuit layout description of an integrated circuit embodyingthe decoding and/or encoding apparatus; and an integrated circuitgeneration system configured to manufacture the decoding and/or encodingapparatus according to the circuit layout description.

There may be provided computer program code for performing a method asdescribed herein. There may be provided non-transitory computer readablestorage medium having stored thereon computer readable instructionsthat, when executed at a computer system, cause the computer system toperform the method as described herein.

The above features may be combined as appropriate, as would be apparentto a skilled person, and may be combined with any of the aspects of theexamples described herein.

BRIEF DESCRIPTION OF THE DRAWINGS

Examples will now be described in detail with reference to theaccompanying drawings in which:

FIG. 1 is a schematic diagram showing an example encoding method;

FIG. 2 is a flow diagram showing the encoding method from FIG. 1;

FIG. 3 is a graphical illustration of the encoding method shown in FIGS.1 and 2;

FIG. 4 is a further graphical illustration of the encoding method shownin FIGS. 1 and 2;

FIG. 5 is a schematic diagram showing an example decoding method;

FIG. 6 is a flow diagram showing the decoding method from FIG. 5;

FIG. 7 is a graphical illustration of the decoding method shown in FIGS.5 and 6;

FIG. 8 is a schematic diagram of exemplary computing-based device whichmay be implemented as any form of a computing and/or electronic device,and in which embodiments of the encoding method of FIGS. 1 and 2 may beimplemented;

FIG. 9 is a schematic diagram of example decoding hardware whichimplements the decoding method of FIGS. 5 and 6;

FIG. 10 is a schematic diagram of a software tool arranged toautomatically generate hardware and software to implement the encodingand decoding methods described herein;

FIG. 11 shows a computer system in which the encoding and/or decodingmethods described herein may be implemented; and

FIG. 12 shows an integrated circuit manufacturing system for generatingan integrated circuit embodying a decoding and/or encoding apparatus asdescribed herein.

The accompanying drawings illustrate various examples. The skilledperson will appreciate that the illustrated element boundaries (e.g.,boxes, groups of boxes, or other shapes) in the drawings represent oneexample of the boundaries. It may be that in some examples, one elementmay be designed as multiple elements or that multiple elements may bedesigned as one element. Common reference numerals are used throughoutthe figures, where appropriate, to indicate similar features.

DETAILED DESCRIPTION

The following description is presented by way of example to enable aperson skilled in the art to make and use the invention. The presentinvention is not limited to the embodiments described herein and variousmodifications to the disclosed embodiments will be apparent to thoseskilled in the art.

Embodiments will now be described by way of example only.

As described above, instructions are typically mapped to instructionwords. By using shorter instruction words, the code density (and hencethe memory bandwidth for loading the instructions and memory size tostore the instructions) is reduced; however, this may limit the possiblefunctionality of the instruction set and so the encoding software anddecoding hardware may need to be able to switch between two modes: afirst mode which uses standard length instruction words and a secondmode which uses reduced length instruction words, and a specialinstruction is required to trigger the switching between modes.Alternatively, variable length instruction words may be used, withinstructions that are more frequently used being mapped to the shorterinstruction words and instructions that are less frequently used beingmapped to the longer instruction words. However, in such examples thedecoding hardware must be designed to work with instructions with thevariable lengths of instruction words that are used and this increasesthe complexity of the hardware (e.g. in a similar manner to theswitching between modes described above). Additionally it is typicallycomplex to add a new instruction to an instruction set which usesvariable length instruction words and the process is prone to errors.The new instruction may be implemented by adding a new field to the endof the existing instruction word format; however, this means that thenew instruction word will be long (thereby reducing overall codedensity, and hence efficiency, of a program comprising the newinstruction) and requires changes to the encoding and decoding softwareand hardware (which is complex, costly and error-prone). The addition ofa new instruction may also result in branching instruction encodingswhere a particular feature in the hardware is not available in allencodings.

Described herein are methods of encoding and decoding that use variablelength instruction encoding. Unlike the methods described above, themethods described herein do not use encodings in which each instructionin an instruction set is mapped to a different single instruction wordof variable length (such that different instructions within the set aremapped to different instruction words having different lengths). Insteadthe methods described herein map the instructions in an instruction setto a variable number of instruction words (e.g. between 1 and Ninstruction words, where N is an integer) and where the length of aninstruction word may be fixed or may be a multiple of a fixed length(e.g. such that instruction words comprise aL bits where L is fixed anda is an integer and may vary between instruction words), with differentinstructions within an instruction set being encoded using differentnumbers of instruction words. The length of the instruction words thatare used (e.g. the length of all the words where the length is fixed orthe value of L, which may be referred to as the ‘unit length’) may beset dependent upon the characteristics of a particular memory system (orsub-system). The methods described herein may also accommodate multipledifferent mappings (e.g. for different types of ALUs, different shaders,different processors or variants of processors, etc.).

As described in more detail below, to encode an instruction from aninstruction set, the bits within an instruction (in canonical form) arere-arranged (or shuffled) and formed into a plurality of instructionwords (e.g. N instruction words, where the value of N may be the samefor all instruction sets or may be different for different instructionsets or may be different for different instructions within the sameinstruction set) according to an encoding (or mapping) type, where theseinstruction words may be of a fixed length or may have a length which isa multiple of a fixed unit length. The plurality of instruction wordscomprise an ordered sequence of instruction words and in variousexamples, each instruction (or each instruction of a particularinstruction type) may be divided into the same number of instructionwords. This ordered of sequence of instruction words is then reduced inlength by removing one or more instruction words that only comprise bitsthat have values which match predicted values (which may alternativelybe referred to as expected or default values) for those bits and theshortened sequence, comprising M instruction words (where M is aninteger and 1≤M≤N) is output. The mappings and the predicted values maybe generated based on empirical data and/or simulation data (asdescribed in more detail below).

In various examples, the shortening of the sequence of instruction wordsmay be performed by truncating the sequence to remove one or more (e.g.any) instruction words at the end of the sequence that only comprisebits that have values which match the predicted values. When performingthe truncation, bits in the instruction are compared to the predictedvalues for the bits. The encoded form of an instruction may thereforecomprise the first M instruction words which do not comprise only bitswhich are the same as the predicted values. Any of the first M words maycomprise some bits that are the same as the predicted values as long asthere is at least one subsequent bit in the same instruction word or alater instruction word in the sequence that is different from thepredicted value.

In other examples, the shortening of the sequence of instruction wordsmay be performed using a mask to discard one or more instruction wordsthroughout the ordered sequence of instruction words (i.e. notnecessarily from the end of the sequence as is the case when usingtruncation). In various examples an N-bit mask may be used (i.e. one bitfor each of the instruction words in the sequence of instruction words),with each bit in the mask describing whether the correspondinginstruction word in the sequence should be encoded or have the predictedvalue (and hence be removed from the sequence), e.g. if N=4 and the maskis 0101 (with the LSB to the right), the shortening of the sequence ofinstruction words retains the first and third instruction words (asindicated by the ‘1’s in the mask) and removes the second and fourthinstruction words (as indicated by the ‘0’s in the mask). The mask maybe generated as part of the encoding process, for example by comparingbits in the instruction to the predicted values for the bits.

The encoding method may be used to encode compiled instructions, e.g. atthe end of the compilation process (which may be referred to as deferredencoding) or later. If the encoding is performed subsequent tocompilation, the same program binary may be used for different processorhardware (e.g. different types of processor or different variants of thesame processor) by using a different encoding type when performing theencoding. This may, for example, enable execution of the same compiledbinary file on a number of processor variants by translating to thenative encoding of each variant at run-time, i.e. when loading anapplication (or other program) from host memory into processor (e.g.GPU) memory (i.e. before the program is first used by the GPU or otherprocessor). This reduces the overall size of the delivered binary formulti-platform applications.

As described in more detail below, to decode an instruction, a pluralityof instruction words (e.g. F instruction words) are fetched and thenbased on an encoding (or mapping) type, which may be determined from thefetched instruction words, an ordered sequence of at least N instructionwords (where N may be fixed or may be different for differentinstruction sets or different instructions within the same instructionset) is generated by selecting, for each word in the ordered sequence,either a fetched instruction word or a predicted instruction word. Whengenerating the sequence, some of the later instruction words that havebeen fetched may be discarded and replaced by predicted instructionwords because, as described above, an instruction is encoded as Minstruction words (where 1≤M≤N) and in examples where M<F, some of the Finstruction words which are fetched will relate to the nextinstruction(s). In examples where the plurality of instruction words arefetched from higher levels of cache (e.g. main memory or an L3 cache),more than N instruction words and/or more than M instruction words maybe fetched (such that F>N and/or F>M) with F being selected such thatthe fetch operation is an efficient operation within the cachehierarchy. In examples where the plurality of instruction words areinstead fetched from lower levels of cache (i.e. levels of the cachecloser to the processor e.g. an L1 or L2 cache), only the exact numberof words that are required may be fetched (such that F=M), with thisnumber of words (F) being determined based on bits (e.g. END bits)within the stored instruction words (as described in more detail below).The bits within the sequence of instruction words are then re-arranged(or de-shuffled) according to an encoding (or mapping) type (i.e. in areverse of the process performed when performing the encoding) togenerate a decoded instruction.

The decoding method may be implemented within a decode stage of aprocessor and may be implemented in hardware and/or software (e.g.microcode). The decoding method may also be implemented within adisassembler (which may be implemented in software).

Described herein is also a tool which automatically generates thehardware description (e.g. in VHDL, Verilog or other hardwaredescription language) for a decoder that implements the decoding methoddescribed herein, software for use in implementing the encoding methoddescribed herein and/or software for use in implementing the decodingmethod described herein. The software tool may also automaticallygenerate human-readable documentation detailing the mapping used tore-arrange the bits for a particular encoding (or mapping) type. Byusing the tool to generate these automatically (and in particular, toautomatically generate both the encoding software and decodinghardware/software together), it reduces the possibility of errors beingintroduced in the hardware, software or human-readable document andhence improves the reliability of the encoding and decoding operations.Methods of generating and optimizing the mapping used are also described(which improves the efficiency of the encoding scheme) and thisfunctionality may also be implemented within the tool.

The method of encoding can be described with reference to FIGS. 1-4.FIG. 1 is a schematic diagram showing the encoding method which may beimplemented in software (e.g. running on hardware such as a processor)and FIG. 2 is a flow diagram showing the encoding method. In exampleswhere the encoding is performed at the end of the compilation process,the encoding method may be implemented within a compiler or assembler.In examples where the encoding is performed at run-time (as describedabove), the encoding method may be implemented on the processor runningthe operating system (e.g. which loads an application or other programfrom host memory into processor memory) or on another processor (e.g. aprocessor within the GPU which loads an application or other programfrom host memory into GPU memory). As shown in FIGS. 1 and 2, a compiledinstruction 102 and an encoding (or mapping) type identifier 104 arereceived (block 202). The encoding type identifier 104 determines themapping between bit positions in the compiled instruction 102 and theoutput (or transmitted) instruction 106 and this mapping may be storedin a look-up table or in any other manner. The encoding type identifier104 also determines the predicted values for all of the bits and thesepredicted values may be stored in a look-up table or in any othermanner. In various examples, the encoding type identifier 104 is used toperform a look-up function to access both the mapping (which is used inblock 204) and the predicted values (which are accessed in block 206 andused in block 208). In other examples, the mapping and predicted valuesmay be provided directly (in block 202) instead of, or in addition to,the encoding type identifier 104.

Different mappings (and optionally different predicted values) and hencedifferent encoding type identifiers 104 may be used in many differentcircumstances. For example, different mappings may be used forinstructions that are executed by different types of ALUs and/or by ALUsof the same type which are used differently (e.g. ALUs of the same typewhich are in different shaders within a GPU) and/or instructions thatare executed using different hardware or different versions of the samehardware. As described in more detail below, the mappings may bedetermined based on usage analysis.

Having received the compiled instruction 102 (in block 202), the bits inthe received instruction 102 are shuffled into their transmission orderand grouped into a sequence of instruction words (block 204). There-ordering of bits that is performed is based on the mapping for theparticular encoding type (as identified by the encoding type identifier104) and, as described above, this mapping may be stored in a look-uptable and accessed using the received encoding type identifier 104. Thisshuffling of bits and formation of instruction words (in block 204) canbe further described with reference to FIG. 3.

FIG. 3 shows the payload of (i.e. the data relating to) an exampleinstruction as received 302 which comprises four source fields (SRC1-4,each comprising 8 bits, labeled 0-7) and three destination fields(DEST1-3, each comprising 8 bits, labeled 0-7) and the same instructionpayload after the bits have been shuffled and grouped into twoinstruction words 304A, 304B (in block 202). In the shuffle operation(in block 202), the bits within the received instruction are re-orderedand as shown in FIG. 3, this does not necessarily comprise re-orderingcomplete fields, although some fields may be re-positioned with all thebits staying contiguous (e.g. fields SRC1, SRC2, SRC4, DEST2 and DEST3in the example shown). When performing the shuffling of bits (in block202), bits from fields may be separated and re-ordered in any way and invarious examples, the bits from a field may be separated so that theyare no longer contiguous.

As described above, the mapping which is used to perform the shufflingoperation (in block 202) specifies two positions for each bit in theinstruction: the first position is the position of the bit in thereceived instruction 102, 302 and the second position is the instructionword into which the bit is placed (e.g. word 304A or 304B) andoptionally the position within that word. Hence the mapping inherentlyspecifies the value of N for the particular instruction (i.e. as aconsequence of the number of instructions specified within the mapping)and the length of any particular instruction word (i.e. as a consequenceof how many fields/bits are allocated to a particular instruction word).The mapping that is used is selected based on the encoding typeidentifier 104 (which in various examples may be implemented as theopcode of an instruction).

In addition to using the encoding type identifier 104 to determine themapping that is used and hence how the bits are shuffled and groupedinto instruction words (in block 204), the encoding type identifier 104may also be used to access predicted words, i.e. predicted values forsome or all of the bits in the instruction (block 206). In variousexamples, however, the predicted values for all the bits in theinstruction may be the same for all instructions in the instruction set(or across all instruction sets) and all encoding type identifiers (e.g.the predicted values may be all ones or all zeros or any pre-definedpattern of ones and zeros) in which case there is no need to accesspredicted values (and block 206 may be omitted or optimized out duringsynthesis of the software). In other examples where the number ofdifferent (e.g. non-zero) bits is limited, block 206 may be partiallyoptimized out during the synthesis of the software.

The mapping which is used to shuffle the order of the bits in theinstruction 102 and form them into instruction words (in block 204) maybe generated in a number of ways. Empirical data can be generated byfeeding typical content into a compiler and/or assembler capable ofgenerating the target instruction set and analyzing the output.Alternatively a simulation could be performed on typical content whichattempted to predict which features of the instruction set would be mostcommonly used. In both cases the result would be a table of all theinstruction bits ordered by their frequency of use with the mostfrequently changing bits listed first. This then provides an initialordering for the bits in an instruction. For example, there may bedifferent mappings for the same ALU but for different uses, e.g. thesame type of ALU may have a different mapping depending upon whether theALU is part of a pixel shader, a vertex shader or a compute shaderand/or based on the instruction type. Those bits which have a highervariance (e.g. those bits with an average value over all instances ofthe instruction which is closer to 0.5) are placed at (or towards) thestart of the ordered sequence of instruction words (e.g. into the firstword 304A) and those bits which have a lower variance (e.g. those bitswith an average value over all instances of the instruction which iscloser to either one or zero) or do not change at all (e.g. those bitswith an average value over all instances of the instruction which isequal to either one or zero) are placed towards the end of the orderedsequence of instruction words (e.g. into the second word 304B).

In order to achieve compression (i.e. the reduction of the number ofinstruction words transmitted), the mapping may control which word anyparticular bit is shuffled and grouped into, with bits then being placedanywhere within a word. In some examples, however, the mapping may alsocontrol placement of bits within an instruction word, e.g. to save logicin the decoding hardware by reducing differences between instructions.

Referring to the example shown in FIG. 3, the usage analysis mayidentify that bits 0-3 of the SRC3 field toggle more frequently than thefollowing four bits (bits 4-7) of the SRC3 field and hence bits 0-3 ofthe SRC3 field are placed towards the start of the ordered sequence ofinstruction words (e.g. into the first instruction word 304A) whilstbits 4-7 of the SRC3 field are placed later in the ordered sequence ofinstruction words (e.g. into the second instruction word 304B). The samemay also be found for DEST1 (e.g. such that the first three bits of thefield are placed into the first instruction word 304A and the last threebits of the field are placed into the second instruction word 304B). Itmay also be found that all the bits of SRC4 and DEST3 remain zero mostof the time and so these fields are placed in their entirety towards theend of the ordered sequence of instruction words (e.g. into the secondinstruction word 304B).

As described above, the mapping that is used in the shuffle operation(in block 204) is identified based on the encoding type identifier 104(received in block 202). The number of bits within an encoding typeidentifier 104 which are used to specify the encoding may be of a fixedlength or a variable length. For example, if the encoding typeidentifier 104 comprises three bits, the encoding may be specified byone, two or three of those bits, as shown in the table below:

Encoding type identifier Number of bits used to (LSB to the right)Encoding type specify encoding 000 F16 instruction 1 (first bit = 0) 100F16 instruction 1 (first bit = 0) 010 F16 instruction 1 (first bit = 0)110 F16 instruction 1 (first bit = 0) 001 F32 instruction 3 101 Integerinstruction 3 011 Memory load/store 2 (first two bits = 11) 111 Memoryload/store 2 (first two bits = 11)

As part of the shuffle operation the bits in the instruction are formedinto an ordered sequence of instruction words 304A, 304B (in block 204,e.g. into N words, where N is an integer which may be fixed orvariable). Then the instruction words 304A, 304B are compared to theirpredicted values and one or more words that comprise only bits that havevalues that match the predicted values are removed from the sequence togenerate a shortened ordered sequence comprising M words, where M is aninteger and 1≤M≤N (block 208). Control bits 310, 312 may then be addedto one or more of the words in the shortened sequence (e.g. in a headerportion and/or a tail portion). The instruction in compressed form 106which comprises the shortened ordered sequence of M words with any addedcontrol bits (e.g. DWORD1 306 and optionally DWORD2 308) is then output(block 210).

In the example shown in FIG. 3, control bits may be added in the form ofheader and/or tail portions. In the example shown in FIG. 3, eachinstruction word 306, 308 comprises a tail portion 310 which comprisesan end bit and the first instruction word 306 also comprises a headerportion 312 which comprises the encoding type identifier 104 (referredto as the TYPE ID). In examples where the value of N is variable, thetail portion 310 or the header portion 312 may comprise one or more bitswhich specify the value of N (e.g. as part of the encoding typeidentifier 104).

As described above, the shortening of the sequence of instruction words(in block 208) is based on the comparison to the predicted words and maybe performed by truncation (e.g. by removing those words at the end ofthe sequence that comprise only bits that have values that match thepredicted values) or using a mask (e.g. by removing words that compriseonly bits that have values that match the predicted values from anyposition in the sequence).

The output instruction words may be of a fixed (i.e. predefined) size ortheir size may be variable (e.g. length=aL, where a is a variableinteger and L is a unit length) and one or more of the outputinstruction words may additionally comprise control bits (e.g. in theform of a header portion and/or a tail portion, as described above).

The predicted values of the bits used in the comparison (in block 208),which form the core of compression scheme, may be generated in a numberof ways. Empirical data can be generated by feeding typical content intoa compiler and/or assembler capable of generating the target instructionset and analyzing the output. Alternatively a simulation could beperformed on typical content which attempted to predict which featuresof the instruction set would be most commonly used. In both cases theresult would be a table of all the instruction bits ordered by theirfrequency of use with the most frequently changing bits listed first.This then provides the initial ordering for the words containing thepredicted values; however, the final ordering may be a modified versionof this initial ordering. The predicted values, like the mappings, maybe determined at any level of granularity and multiple instructionswithin an instruction set may share the same mapping or predicted values(e.g. there may be two instructions within an instruction set which usethe same mapping but different predicted bits). The predicted values maythen be set to the most likely value for each of the bits in theinstruction (e.g. if a bit in the instruction has a value of one formore than 50% of the cases included in the usage analysis, the predictedvalue may be set to one and if a bit in the instruction has a value ofzero for 50% or more of the cases included in the usage analysis, thepredicted value may be set to zero). In various examples, instead ofonly considering one instruction at a time, the correlation of predictedbit values may also be considered, e.g. such that the predicted valuesused depend upon the values of other bits in the same instruction and/orthe same bit in other instructions (e.g. the immediately previousinstruction). In other examples the predicted values of all the bits maybe fixed to the same value (e.g. a one or a zero), in which case it isnot necessary to access the predicted values (and block 206 may beomitted or optimized out). In other examples, as described above, wherethe number of different (e.g. non-zero) bits is limited, block 206 maybe partially optimized out during the synthesis of the software.

As shown in FIG. 1, in various examples comparisons are performed on aper-bit basis 108 (in block 208A) and then the results are combined 110such that the end bit in the tail portion 310 of an output instructionword is set if all the subsequent instruction words comprise only bitsthat equal their predicted value (block 208B). Those subsequentinstruction words (which comprise only bits that equal their predictedvalue) are then removed from the sequence of instruction words (block208C), such that only the first M instruction words that are not thesame as the predicted words are output (in block 210).

In other examples, where a mask is used, data identifying the mask, orthe mask bits themselves, may be included within the header or tailportions of one or more output instruction words. For example, the firstoutput word may contain (e.g. in the header/tail portion) a mask bit forthe second word, the second output word may contain a mask bit for thethird word, etc. The value of the mask bit in the first output word mayhave two possible values, one that indicates that the second word ispresent and the other that indicates that the second word is not presentbut the third word is present. Similarly, the value of the mask bit in asubsequent output word may have two possible values, one that indicatesthat the next word in the sequence is present and the other thatindicates that the next word is not present but the word following thenext word is present.

The comparison process can be further described with reference to theexample shown in FIG. 4. In this example, the instruction 402 (which maybe a compiled instruction) comprises 16 bits. The bits in theinstruction 402 are shuffled and grouped (in block 204) according to themapping for the appropriate encoding type (as identified based on theencoding type identifier 104 received in block 202) to form a pluralityof instruction words 406.

Some or all of the instruction words 406 are then compared to thepredicted values for the bits 408 (in block 208). It can be seen fromthe schematic diagram in FIG. 1, that as one instruction word (e.g.DWORD1) is always output (in block 210), the comparison between bits andtheir predicted values may be omitted for this first instruction word(as indicated by the dotted outline of the predicted values for thefirst word in FIG. 4) and this reduces the processing effort involved inthe encoding operation. More generally, if a minimum of X instructionwords are always used for an instruction (where X=1 in the example shownbut in other examples X may be greater than one, such that X≤M≤N), thecomparison may not be performed for the first X instruction words.

As described above, each transmitted instruction word may comprise oneor more control bits, e.g. a header portion 414 and/or a tail portion412. In various examples, the first instruction word comprises anencoding type identifier 414 which may be exactly the same as thereceived encoding type identifier 104 or may provide the sameinformation in a different format. In various examples, each transmittedinstruction word comprises one or more bits 412 (which may be referredto as an end bit) which indicate whether this is the last transmittedinstruction word for an instruction. In the example shown in FIG. 4, allthe bits in the second instruction word match the predicted values andso only the first instruction word is transmitted (and hence forms thetransmitted instruction 410) and the end bit in the tail portion 412 ofthe first instruction word is set.

Although FIG. 4 shows the first transmitted instruction word in thetransmitted instruction 410 comprising the encoding type identifier 414(e.g. as part of the control bits within that instruction word), inother examples this encoding type identifier may be included in anotherway within the transmitted instruction 410.

In the method described above, the instruction is compressed prior totransmission through the omission of any instruction words at the end ofthe sequence of instruction words where all the bits have the predictedvalues (e.g. by the omission of the second instruction word in theexample shown in FIG. 4) or through the omission of instruction words atany point in the sequence through the use of a mask. In variousexamples, the instruction may be further compressed by re-purposing bitsfrom one field (e.g. the TYPE ID) field, as described with reference tothe table above. This technique may also be described as use of variablelength encoding type identifiers (or other) fields. For example, if theencoding type identifier 104 comprises three bits, there are eightpossible values and eight possible encodings. If, however, there arefewer than eight different values which are used, then one or more ofthe encoding type identifier field bits (labeled ‘TYPE ID’ in the FIG.4) may be re-purposed, e.g. if only four different values are used, thenonly the first two bits of the encoding type identifier need be used andthe remaining bit (the third bit in the encoding type identifier field)can be used to encode other data because its value is irrelevant whendecoding the encoding type identifier field.

In the methods described above, the predicted values and/or mapping aredetermined based on the received encoding type (from block 202) whichinherently identifies the ALU type which will execute the instruction,although there may be multiple different encodings for the same ALUtype. In a variation of the encoding method described above, thepredicted values and/or mapping may additionally be determined based oncontext information (i.e. in combination with the received encodingtype). The context information may, for example, be the type of program(e.g. shader) in which the instruction will be executed (e.g. theprogram may, for example be a vertex shader, pixel shader or computeshader). In addition, or instead, the context information may be otherdata which could be determined when executing the program, such aswhether the instruction is within a conditionally executing branch, orany other metadata associated with an instruction which does not need tobe explicitly encoded in the instruction.

Although the encoding method is shown in FIGS. 1 and 2 as being appliedto a compiled instruction (e.g. at the end of the compilation process orlater), it will be appreciated that in other examples, the encodingmethod described may be implemented at an earlier stage within acompiler.

The method of decoding can be described with reference to FIGS. 5-7.FIG. 5 is a schematic diagram showing the decoding method which may beimplemented in hardware and/or software, e.g. within a fetch stage anddecode stage of a processor. FIG. 6 is a flow diagram showing thedecoding method. As shown in FIGS. 5 and 6, one or more instructionwords (e.g. F instruction words) 502 are fetched (block 602), e.g. bythe instruction fetch unit. In various examples, the fetch operation (inblock 602) may be implemented in a number of stages: firstly a pluralityof (e.g. N) end bits are fetched (block 602A), then based on the valuesof the fetched end bits the number of words to be fetched (e.g. F) isdetermined (block 602B), and then that number of words are fetched(block 602C). By implementing the fetch operation in this way, thebandwidth requirement on the memory in which the instruction words arestored is reduced (because the minimum number of instruction words arefetched). Alternatively, the number of instruction words that arefetched (F, where F is an integer and F≥1) may be fixed or determined insome other way (e.g. by fetching a first instruction word, checking itsend bit, depending upon the value of the end bit, fetching anotherinstruction word, checking its end bit, etc.).

In various examples, the end bits (and/or other control bits) may bestored in a separate type of memory (e.g. a lower latency memory) thanthe rest of the instruction words that are fetched. This enables accessto the end bits quickly (due to the lower memory latency).

Having fetched one or more instruction words (in block 602), an encodingtype is determined from the fetched instruction words 502 (block 604),e.g. by the decode stage. As described above, each instruction word maycomprise a tail portion 412 which may, for example, comprise an end bit,and the first instruction word (from the plurality of instruction wordsthat are fetched) may comprise a portion 414 (e.g. a header portion)which identifies the encoding type used when generating the instructionwords (e.g. the encoding type identifier). The encoding type maytherefore be determined (in block 604) from this portion 414. Theencoding type may, for example, correspond to the ALU type which willexecute the particular instruction and optionally other information(e.g. context information).

At this stage, any control bits in the fetched instruction words may beremoved. As noted above, in various examples, the end bits (and/or othercontrol bits) may be stored separately from the instruction words so maynot need to be removed from the fetched instruction words.

As described above with reference to FIGS. 1-4, a single instruction maybe compressed into one or more instruction words, e.g. M instructionwords, where M is an integer and 1≤M≤N (or more generally X≤M≤N whereX≥1). Consequently, the F instruction words which are fetched (in block602) comprises M instruction words which correspond to the instructionbeing decoded and may also comprise F-M instruction words whichcorrespond to one or more subsequent instructions, depending upon thevalue of F (and where, as described above, the value of F may bedifferent depending upon which level of cache the instruction words arefetched from). As described below, any instruction words which arefetched (in block 602) but which do not relate to the particularinstruction which is being decoded, are discarded later in the method(in block 610). In examples where additional words are only fetched whenfetching from a higher level of cache (i.e. levels of the cache furtherfrom the processor), then these additional words (over and above the Mwords required) may be considered to be a pre-emptive data fetch and maybe used when decoding a subsequent instruction (e.g. assuming that theprogram counter increments and does not branch).

The encoding type identifier 104 is used to identify (e.g. access) thepredicted words (i.e. predicted values for all of the bits in theinstruction words) and these predicted words may be stored in a look-uptable or in any other manner. The encoding type identifier (or otherdata in portion 414) is also used to identify (e.g. access) a mappingfor the encoding type. The mapping specifies the positions of the bitsboth in the received instruction words 502 (when arranged in order) andin the decoded instruction 504 and this mapping may be stored in alook-up table or in any other manner. In various examples, the encodingtype identifier is used to identify (e.g. access) both the mapping(which is used in block 612) and the predicted words (which are used inblock 610). In various examples, other factors, such as the instructiontype, context information or any other information that is known by boththe compiler/assembler (or other entity that performs the encoding) andthe hardware that executes the instruction (and hence performs thedecoding) may also be used to identify the predicted words and/ormapping.

In various examples, all the bits in the predicted words may be the samefor all instructions and all encoding type identifiers (e.g. allpredicted words may comprise bits which are all ones or all zeros or anypre-defined pattern of ones and zeros) in which case there is no need toidentify (e.g. access) predicted words.

Having fetched F instruction words (in block 602) and identified thepredicted words (e.g. based on the encoding type which is determined inblock 604), for each of the N instruction words which make up theinstruction, either a fetched instruction word (i.e. one of the Ffetched instruction words) or a predicted instruction word is selected(block 610).

In various examples, the selection (in block 610) may be made based onthe values of the end bits 412 in one or more of the fetched instructionwords, as shown in the example in FIG. 5. In this example, the selectionis made by multiplexers 508 which are controlled based on the values ofthe end bits 412, as combined using OR gates 510. For the first of the Ninstruction words (which will make up the decoded instruction 504), thefirst of the F fetched instruction words (WORD1) is always selected(because the transmitted instruction always comprises at least oneinstruction word). For the second of the N instruction words, the secondof the F fetched instructions (WORD2) is selected if the end bit is notset in the first instruction word (WORD1); however, if the end bit isset in the first instruction word (thereby indicating that it is thelast instruction word in the transmitted instruction), then thepredicted word is selected instead. Similarly, for the n^(th)instruction word that will make up the decoded instruction 504, where1<n≤N, the f^(th) fetched instruction word is selected, where 1<f≤F,unless the end bit is set in any of the preceding fetched instructionwords. If the end bit is set in any of the preceding fetched instructionwords, or if there is no corresponding fetched instruction word (i.e.because F<N) the predicted word is selected instead.

In the hardware implementation shown in FIG. 5, the predicted words(i.e. the predicted bit values within the predicted words) are datainputs to the multiplexers 508 and the mapping provides control bits forthe multiplexers within the re-order (or de-shuffle logic) 506.

The N selected words (from block 610) are placed in order (as notedabove, any control bits, which may be in header or tail portions, havealready been removed from the words) and then re-ordered (which may alsobe described as de-shuffling) using the mapping (block 612). The resultof the re-ordering operation (in block 612 and logic 506) is the decodedinstruction 504 which is output (block 614).

The selection operation (in block 610) and re-ordering operation (inblock 612) can further be described with reference to the example shownin FIG. 7 which is the decoding operation which corresponds to theencoding example shown in FIG. 4. As shown in FIG. 7, F instructionwords 702 are fetched (in block 602) and in this example F=2. The endbit 412 in the first word 702A is set and consequently, in the selectionoperation (in block 610), the first fetched instruction word 702A isselected and the second fetched instruction word 702B is not selectedand instead the corresponding predicted instruction word (i.e. thepredicted second instruction word) is selected. As shown in FIG. 7,prior to performing the selection, any control bits (e.g. the headerportion 414 and tail portion 412) are removed and the selection is thenperformed on the fetched instruction words without the control bits 703.

The selected instruction words 704 (comprising the first fetchedinstruction word without the control bits 703A and a second predictedinstruction word) are then concatenated (i.e. placed in order) to form ashuffled instruction 706 and the mapping for the identified encodingtype is used to re-order (or de-shuffle) the bits in the shuffledinstruction 706 to produce the re-ordered instruction which may also bereferred to as the de-shuffled instruction or decoded instruction 708.

By comparing the examples shown in FIGS. 4 and 7, it can be seen thatthe first fetched instruction word 702A corresponds to the transmittedinstruction 410 and the second fetched instruction word 702B does notcorrespond to any instruction word in the transmitted instruction 410(this second fetched instruction word 702B is part of a next transmittedinstruction). The selected instruction words 704 in the decodingoperation match the instruction words 408 in the encoding operation andthe decoded instruction 708 matches the original instruction 402.

Although the description of FIGS. 6 and 7 above refers to the removal ofthe control bits before the formation of the shuffled instruction 706(and hence before the re-ordering operation), in other examples, thecontrol bits may be retained within the instruction words. For example,where bits from the encoding type identifier (TYPE ID, in the headerportion 414) are re-purposed (as described with reference to the tableabove), at least those control bits comprising the encoding typeidentifier may be retained in the selected instruction words (e.g. onlythe end bits 412 may be removed) and included in the shuffledinstruction.

In the example described above with reference to FIG. 5, the first ofthe F fetched instruction words (WORD1) is always selected because thetransmitted instruction always comprises at least one instruction word.More generally, if the transmitted instruction always comprises at leastX instruction words (where X=1 in the example shown but in otherexamples X may be greater than one, such that X≤M≤N), the first X of theF fetched instruction words are always selected and a decision to selectthe fetched instruction word or a predicted selection word is only madefor subsequent instruction words (e.g. for the (X+1)^(th) to N^(th)instruction words).

In the description of the decoding method above, it is assumed that thecompressed instruction was generated by truncating the sequence ofinstruction words. In other examples, however, and as described above,the compressed instruction may be generated by removing words from anyposition in the ordered sequence of instruction words using a mask. Insuch examples, the selection of a fetched instruction word or apredicted word (in block 610) may be made based on a mask identifiedusing the encoding type and in such examples, when selecting the n^(th)instruction word, either the corresponding predicted word or the nextfetched instruction (which has not already been selected) is selected.For example, if N=4 and the mask comprises four bits: 0101, for thefirst of the N instruction words, the first fetched instruction isselected, for the second of the N instruction words, a predicted word isselected, for the third of the N instruction words, the second fetchedinstruction is selected and for the fourth of the N instruction words, apredicted word is selected.

Although in the decoding examples described above the decodedinstruction (output in block 614) comprises the same number of bits,excluding any control bits, as the corresponding received compiledinstruction (as received in block 202), again excluding any controlbits, and hence there are the same number of instruction words in theordered sequence formed from the received compiled instruction (in block204) and the sequence of instruction words generated when decoding (inblock 610), in other examples there may be more bits in the decodedinstruction, excluding any control bits, than the corresponding receivedcompiled instruction (prior to encoding and again excluding any controlbits). This may, for example, occur where an instruction comprises morebits than can be accommodated in the maximum number of instruction words(i.e. in N instruction words). In such examples, the compiler/assemblermay generate one of a number of different compiled versions of the sameinstruction dependent upon how the instruction is being used, with thedifferent versions omitting different fields from the instruction (e.g.one omitting a look-up table field and another omitting a DEST6 field).The compiler/assembler will then select the appropriate compiled versiondepending upon which fields are unused and the different versions willhave different encoding types such that within the decoding operation,the omitted fields are reinserted (in block 610) by selecting a defaultinstruction word.

In some of the examples described above N=2. In other examples describedabove N=4. In variations on the examples described above, N may haveother values, e.g. N may be greater than four. Selection of the value ofN and the length of an instruction word provides control over thegranularity of the variable length encoding and decoding. A finergranularity, i.e. a larger value of N and smaller length of instructionswords, results in a larger overhead (e.g. more instruction word controlbits and more hardware logic).

Using the encoding and decoding methods described above, it may bepossible to reduce the size of instructions by about 50% (e.g. whereN=4, the average value of M for all the instructions in an instructionset may be approximately two). The methods described herein effectivelyprovide a lossless compression method for a shader program. The methodsdescribed herein increase the code density and reduce the memory sizeand memory bandwidth required. Furthermore, the methods provideflexibility to change the mapping (e.g. for different variants ofhardware or to add new instructions) without requiring manual changes(i.e. changes made by a person) to the decoding hardware or necessarilysignificantly decreasing code density. The overall effort required togenerate the hardware, software and documentation in relation to theencoding and decoding methods is reduced. The mappings may also bemodified based on further usage data or more use-specific usage data tofurther improve code density without requiring a change in hardware or achange to the compiler/assembler.

As described above, the encoding method may be implemented in softwarewhich runs on hardware (e.g. a processor) where the software may be acompiler, assembler or software which implements encoding at a laterstage (e.g. at run-time). FIG. 8 is a schematic diagram of exemplarycomputing-based device 800 which may be implemented as any form of acomputing and/or electronic device, and in which embodiments of theencoding method described above may be implemented.

Computing-based device 800 comprises one or more processors 802 whichmay be microprocessors, controllers or any other suitable type ofprocessors for processing computer executable instructions to controlthe operation of the device in order to implement the encoding methoddescribed above. In some examples, for example where a system on a chiparchitecture is used, the processors 802 may include one or more fixedfunction blocks (also referred to as accelerators) which implement apart of the method of encoding in hardware (rather than software orfirmware). Platform software comprising an operating system 804 or anyother suitable platform software may be provided at the computing-baseddevice to enable application software, including encoding software 806to be executed on the device. The encoding software 806 implements theencoding method described above.

The computer executable instructions may be provided using anycomputer-readable media that is accessible by computing based device800. Computer-readable media may include, for example, computer storagemedia such as memory 808 and communications media. Computer storagemedia (i.e. non-transitory machine readable media), such as memory 808,includes volatile and non-volatile, removable and non-removable mediaimplemented in any method or technology for storage of information suchas computer readable instructions, data structures, program modules orother data. Computer storage media includes, but is not limited to, RAM,ROM, EPROM, EEPROM, flash memory or other memory technology, CD-ROM,digital versatile disks (DVD) or other optical storage, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, or any other non-transmission medium that can be usedto store information for access by a computing device. In contrast,communication media may embody computer readable instructions, datastructures, program modules, or other data in a modulated data signal,such as a carrier wave, or other transport mechanism. As defined herein,computer storage media does not include communication media. Althoughthe computer storage media (i.e. non-transitory machine readable media,e.g. memory 808) is shown within the computing-based device 800 it willbe appreciated that the storage may be distributed or located remotelyand accessed via a network or other communication link (e.g. usinginterface 810).

As well as storing computer-executable instructions which can beexecuted by the processor 802, the memory 808 may also store one or morelook-up tables 812 comprising the mappings and/or predicted valuesdescribed above. Alternatively, the mappings and/or predicted values maybe accessed via the interface 810. The compiled instructions which areencoded by the encoding software 806 (when executed by the processor802) may be stored in the memory 808, received via the interface 810 orgenerated by the processor 802 (e.g. running other software, such as acompiler and/or assembler program, which may be stored in memory 800).

The computing-based device 800 may also comprise additional elementswhich are not shown in FIG. 8, such as an input/output controllerarranged to output display information to a display device which may beseparate from or integral to the computing-based device 800. The displayinformation may provide a graphical user interface. The input/outputcontroller, where provided, may also be arranged to receive and processinput from one or more devices, such as a user input device (e.g. amouse or a keyboard). The display device may also function as the userinput device if it is a touch sensitive display device. The input/outputcontroller, where provided, may also output data to devices other thanthe display device, e.g. a locally connected printing device.

As described above, the decoding method may be implemented in hardwareand/or software, e.g. within a decode stage of a processor. Where thedecoding method is implemented entirely in software, it may beimplemented on a computing-based device such as the one shown in FIG. 8and described above, with the memory 808 being arranged to storedecoding software which can be executed by the processor 802.

FIG. 9 is a schematic diagram of example decoding hardware 900 whichimplements the decoding method described above. As described above, thisdecoding hardware 900 may be part of a decode stage of a processor (e.g.a CPU or GPU). As shown in FIG. 9, the decoding hardware 900 comprisesan input 902 for receiving fetched instruction words 502 (which may, forexample, have been fetched by a fetch stage of the processor) and anoutput 904 for outputting decoded instructions 504 (e.g. to an executionstage of the processor which comprises a plurality of ALUs).

The instruction words may be fetched from within a memory hierarchy (notshown in FIG. 9). As described above, the instruction words may bestored and fetched differently depending upon the particular cachelevel. For example, where instruction words are stored in higher levelsof the cache, the some or all of the control bits (e.g. the end bits)may be stored separately from the rest of the instruction words (e.g. ina different type of memory) and may be fetched ahead of the instructionwords themselves (as shown in blocks 602A-C in FIG. 6) and whereinstruction words are stored in lower levels of the hierarchy (e.g.lower levels of cache), some or all of the control bits (e.g. the endbits) may be stored with the rest of the instruction words such that aninstruction word is fetched at the same time as the end bit (or othercontrol bits) for that particular instruction word.

The hardware 900 further comprises logic 906 for determining theencoding type (e.g. from the fetched instruction words and optionallycontext information) and data stores for the mapping data 908 and thepredicted values 910. As described above, the mappings and the predictedvalues may be stored in any way, e.g. in look-up tables (in memory) andthe mappings and predicted values may be stored independently and/or indifferent manners. The hardware 900 further comprises word selectionlogic 912 which may, for example, comprise an arrangement of logic gates(such as OR gates 510 as shown in FIG. 5) and multiplexers (such as themultiplexers 508 shown in FIG. 5). The predicted values may be used asinputs to the logic within the word selection logic 912 (e.g. asdescribed above with reference to FIG. 5). The hardware 900 additionallycomprises re-ordering logic 914 (which may alternatively be referred toas ‘de-shuffle logic’). The mapping data (as stored in the mapping datastore 908) may be a look-up table for control bits used within there-order logic.

Although FIG. 9 shows the word selection logic 912 and re-order logic914 as separate functional entities, in various examples parts of theword selection functionality 912 may be integrated within the re-orderlogic 914. In such an example, the hardware 900 may comprise threefunctions: logic for determining the encoding type 906, logic forreturning the predicted values (which may be part of logic 912) andlogic for de-shuffling the instruction (which comprises the remainingparts of logic 912 and the re-order logic 914).

Although FIG. 9 shows the mapping data store 908 separately from there-order logic 914, in various examples, the mapping data store 908 maybe integrated into the re-order logic 914. As described above themapping data may be a look-up table for control bits used within there-order logic 914 (e.g. control bits for multiplexers or other logicelements) and the two (the mapping data store 908 and re-order logic814) may be merged together during synthesis of the hardware to reducethe overall amount of hardware logic required to implement the decodingmethod.

A tool which automatically generates both the encoding software 806 andthe hardware description for the decoding apparatus 900 can be describedwith reference to FIG. 10. This tool may generate software for use inimplementing the decoding method described herein (e.g. decodingsoftware which may be run on an apparatus similar to that shown in FIG.8) in addition to, or instead of the hardware description of thedecoding apparatus 900. Additionally the tool may also automaticallygenerate human-readable documentation detailing the mapping used tore-arrange the bits for a particular encoding (or mapping) type and/orperform analysis to optimize the mappings used. As described above bygenerating both the encoding software and the decoding hardware/softwaretogether, the possibility of errors caused by a mismatch between theencoding and decoding processes used is significantly reduced and thisimproves reliability. By additionally generating human-readabledocumentation at the same time, the possibility of errors is furtherreduced (and hence reliability is further improved) and the effortrequired is significantly reduced.

FIG. 10 is a schematic diagram of a tool 1000 (e.g. a software tool thatruns on a processor, such as processor 802). As shown in FIG. 10, thetool 1000 takes as inputs a mapping 1002 and the instructions in aninstruction set in canonical form 1004. The canonical form of aninstruction is the form of the instruction when it is generated by thecompiler/assembler or executed in hardware (e.g. instructions 402, 708).It may be presented to the tool in a human readable or machine readableform. The tool 1000 generates and outputs a hardware description of thedecoding apparatus 1006 (e.g. in VHDL, Verilog or other hardwaredescription language) and encoding software 1008 (e.g. in C). Theseoutputs 1006, 1008 include the mapping data and/or predicted valueswhich may be in the form of look-up tables or in any other form (e.g.for the look-up tables 812 shown in FIG. 8 and the mapping data store908 and predicted values store 910 shown in FIG. 9) and/or values forenumerated data types. The tool 100 may also generate and outputdecoding software 1010 (e.g. in C, where this may be provided inaddition to, or instead of the hardware description 1006) and/ordebugging data and documentation 1012 which is in a human-readable form(e.g. in HTML). The tool 1000 may additionally provide other outputs notshown in FIG. 10.

As shown in FIG. 10, the tool 1000 comprises two grammar and parsingengines 1022, 1024, one for the mapping 1002 and the other for theinstructions 1004. Both of these engines access a grammar andspecification library 1020 to perform the parsing. The grammar andparsing engine for the mapping 1022 outputs a remapping table whichdetails how bits are re-ordered (e.g. in blocks 204 and 612) and whichmay alternatively be referred to as a re-ordering or a shuffling table.The grammar and parsing engine for the instructions 1024 outputs aninternal representation of the canonical instruction format which issuitable for further processing and code generation. The output of thesetwo engines 1022, 1024 is fed into a code and data generation engine1026 and used to generate the code 1008, 1010 and other outputs 1006,1012 of the tool 1000. The code and data generation engine 1026 accessesa second library (referred to herein as the HTML conversion library1028), to convert comments (e.g. programming comments) to HTML.

In various examples, the tool 1000 may additionally receive usage data1032, such as statistical data relating to the instructions generatedusing the encoding software 1008 for the instruction set (e.g. in one ormore different applications) and may comprise an analysis engine 1030(e.g. a bit frequency analysis engine) which generates statisticsregarding the frequency with which each bit in an instruction is toggledand/or differs from the predicted value (e.g. it may perform instructionbit frequency analysis) and may then feedback updated (e.g. optimized)mappings into the tool to further optimize the encoding and decodingmethods used.

FIG. 11 shows a computer system 1100 in which the decoding apparatusdescribed herein may be implemented. The computer system comprises a CPU1102, a GPU 1104, a memory 1106 and other devices 1114, such as adisplay 1116, speakers 1118 and a camera 1120. A processing block 1110(corresponding to the decoding apparatus 900) is implemented on the GPU1104. In other examples, the processing block 1110 may be implemented onthe CPU 1102. The components of the computer system can communicate witheach other via a communications bus 1122. A store 1124 (corresponding tothe mapping data store 908 and/or predicted values store 910) may beimplemented as part of the memory 1106.

The decoding apparatus of FIG. 9 is shown as comprising a number offunctional blocks. This is schematic only and is not intended to definea strict division between different logic elements of such entities.Each functional block may be provided in any suitable manner. It is tobe understood that intermediate values described herein as being formedby the decoding apparatus need not be physically generated by thedecoding apparatus at any point and may merely represent logical valueswhich conveniently describe the processing performed by the decodingapparatus between its input and output.

The decoding apparatus described herein may be embodied in hardware onan integrated circuit. The decoding apparatus described herein may beconfigured to perform any of the decoding methods described herein.Generally, any of the functions, methods, techniques or componentsdescribed above can be implemented in software, firmware, hardware(e.g., fixed logic circuitry), or any combination thereof. The terms“module,” “functionality,” “component”, “element”, “unit”, “block” and“logic” may be used herein to generally represent software, firmware,hardware, or any combination thereof. In the case of a softwareimplementation, the module, functionality, component, element, unit,block or logic represents program code that performs the specified taskswhen executed on a processor. The algorithms and methods describedherein could be performed by one or more processors executing code thatcauses the processor(s) to perform the algorithms/methods. Examples of acomputer-readable storage medium include a random-access memory (RAM),read-only memory (ROM), an optical disc, flash memory, hard disk memory,and other memory devices that may use magnetic, optical, and othertechniques to store instructions or other data and that can be accessedby a machine.

The terms computer program code and computer readable instructions asused herein refer to any kind of executable code for processors,including code expressed in a machine language, an interpreted languageor a scripting language. Executable code includes binary code, machinecode, bytecode, code defining an integrated circuit (such as a hardwaredescription language or netlist), and code expressed in a programminglanguage code such as C, Java, GLSL or OpenCL C. Executable code may be,for example, any kind of software, firmware, script, module or librarywhich, when suitably executed, processed, interpreted, compiled,executed at a virtual machine or other software environment, cause aprocessor of the computer system at which the executable code issupported to perform the tasks specified by the code.

A processor, computer, or computer system may be any kind of device,machine or dedicated circuit, or collection or portion thereof, withprocessing capability such that it can execute instructions. A processormay be any kind of general purpose or dedicated processor, such as aCPU, GPU, System-on-chip, state machine, media processor, anapplication-specific integrated circuit (ASIC), a programmable logicarray, a field-programmable gate array (FPGA), physics processing units(PPUs), radio processing units (RPUs), digital signal processors (DSPs),general purpose processors (e.g. a general purpose GPU),microprocessors, any processing unit which is designed to acceleratetasks outside of a CPU, etc. A computer or computer system may compriseone or more processors. Those skilled in the art will realize that suchprocessing capabilities are incorporated into many different devices andtherefore the term ‘computer’ includes set top boxes, media players,digital radios, PCs, servers, mobile telephones, personal digitalassistants and many other devices.

It is also intended to encompass software which defines a configurationof hardware as described herein, such as HDL (hardware descriptionlanguage) software, as is used for designing integrated circuits, or forconfiguring programmable chips, to carry out desired functions. That is,there may be provided a computer readable storage medium having encodedthereon computer readable program code in the form of an integratedcircuit definition dataset that when processed in an integrated circuitmanufacturing system configures the system to manufacture a decodingapparatus configured to perform any of the decoding methods describedherein, or to manufacture a processor comprising any apparatus describedherein. An integrated circuit definition dataset may be, for example, anintegrated circuit description.

An integrated circuit definition dataset may be in the form of computercode, for example as a netlist, code for configuring a programmablechip, as a hardware description language defining an integrated circuitat any level, including as register transfer level (RTL) code, ashigh-level circuit representations such as Verilog or VHDL, and aslow-level circuit representations such as OASIS (RTM) and GDSII. Higherlevel representations which logically define an integrated circuit (suchas RTL) may be processed at a computer system configured for generatinga manufacturing definition of an integrated circuit in the context of asoftware environment comprising definitions of circuit elements andrules for combining those elements in order to generate themanufacturing definition of an integrated circuit so defined by therepresentation. As is typically the case with software executing at acomputer system so as to define a machine, one or more intermediate usersteps (e.g. providing commands, variables etc.) may be required in orderfor a computer system configured for generating a manufacturingdefinition of an integrated circuit to execute code defining anintegrated circuit so as to generate the manufacturing definition ofthat integrated circuit.

An example of processing an integrated circuit definition dataset at anintegrated circuit manufacturing system so as to configure the system tomanufacture apparatus to perform the encoding and/or decoding methodsdescribed above will now be described with respect to FIG. 12.

FIG. 12 shows an example of an integrated circuit (IC) manufacturingsystem 1202 which comprises a layout processing system 1204 and anintegrated circuit generation system 1206. The IC manufacturing system1202 is configured to receive an IC definition dataset (e.g. defining anencoding and/or decoding apparatus as described in any of the examplesherein and which may, for example, be generated by tool 1000), processthe IC definition dataset, and generate an IC according to the ICdefinition dataset (e.g. which embodies an encoding and/or decodingapparatus as described in any of the examples herein). The processing ofthe IC definition dataset configures the IC manufacturing system 1202 tomanufacture an integrated circuit embodying an encoding and/or decodingapparatus as described in any of the examples herein.

The layout processing system 1204 is configured to receive and processthe IC definition dataset to determine a circuit layout. Methods ofdetermining a circuit layout from an IC definition dataset are known inthe art, and for example may involve synthesising RTL code to determinea gate level representation of a circuit to be generated, e.g. in termsof logical components (e.g. NAND, NOR, AND, OR, MUX and FLIP-FLOPcomponents). A circuit layout can be determined from the gate levelrepresentation of the circuit by determining positional information forthe logical components. This may be done automatically or with userinvolvement in order to optimise the circuit layout. When the layoutprocessing system 1204 has determined the circuit layout it may output acircuit layout definition to the IC generation system 1206. A circuitlayout definition may be, for example, a circuit layout description.

The IC generation system 1206 generates an IC according to the circuitlayout definition, as is known in the art. For example, the ICgeneration system 1006 may implement a semiconductor device fabricationprocess to generate the IC, which may involve a multiple-step sequenceof photo lithographic and chemical processing steps during whichelectronic circuits are gradually created on a wafer made ofsemiconducting material. The circuit layout definition may be in theform of a mask which can be used in a lithographic process forgenerating an IC according to the circuit definition. Alternatively, thecircuit layout definition provided to the IC generation system 1206 maybe in the form of computer-readable code which the IC generation system1206 can use to form a suitable mask for use in generating an IC.

The different processes performed by the IC manufacturing system 1202may be implemented all in one location, e.g. by one party.Alternatively, the IC manufacturing system 1202 may be a distributedsystem such that some of the processes may be performed at differentlocations, and may be performed by different parties. For example, someof the stages of: (i) synthesising RTL code representing the ICdefinition dataset to form a gate level representation of a circuit tobe generated, (ii) generating a circuit layout based on the gate levelrepresentation, (iii) forming a mask in accordance with the circuitlayout, and (iv) fabricating an integrated circuit using the mask, maybe performed in different locations and/or by different parties.

In other examples, processing of the integrated circuit definitiondataset at an integrated circuit manufacturing system may configure thesystem to manufacture an encoding and/or decoding apparatus without theIC definition dataset being processed so as to determine a circuitlayout. For instance, an integrated circuit definition dataset maydefine the configuration of a reconfigurable processor, such as an FPGA,and the processing of that dataset may configure an IC manufacturingsystem to generate a reconfigurable processor having that definedconfiguration (e.g. by loading configuration data to the FPGA).

In some embodiments, an integrated circuit manufacturing definitiondataset, when processed in an integrated circuit manufacturing system,may cause an integrated circuit manufacturing system to generate adevice as described herein. For example, the configuration of anintegrated circuit manufacturing system in the manner described abovewith respect to FIG. 12 by an integrated circuit manufacturingdefinition dataset may cause a device as described herein to bemanufactured.

In some examples, an integrated circuit definition dataset could includesoftware which runs on hardware defined at the dataset or in combinationwith hardware defined at the dataset. In the example shown in FIG. 12,the IC generation system may further be configured by an integratedcircuit definition dataset to, on manufacturing an integrated circuit,load firmware onto that integrated circuit in accordance with programcode defined at the integrated circuit definition dataset or otherwiseprovide program code with the integrated circuit for use with theintegrated circuit.

Further aspects and examples are set out in the following clauses:

Clause 1. A method of encoding instructions from an instruction set, themethod comprising: receiving an instruction from the instruction set;re-ordering and grouping bits in the received instruction into aplurality of instruction words according to an encoding type to generatean ordered sequence of instruction words; comparing bit values in one ormore of the instruction words in the ordered sequence to theircorresponding predicted values and generating a compressed version ofthe instruction by omitting one or more of the instruction words in theordered sequence based on the comparison, wherein the predicted valuesare generated using empirical and/or simulation data; and outputting thecompressed version of the instruction.

Clause 2. The method according to clause 1, wherein the compressedversions of different groups of instructions within the instruction setcomprise different numbers of instruction words.

Clause 3. The method according to clause 1 or 2, wherein generating acompressed version of the instruction comprises: omitting one or moreinstruction words from the ordered sequence that only comprise bits thathave values that match the predicted values for those bits.

Clause 4. The method according to clause 3, generating a compressedversion of the instruction further comprises: setting one or more bitsto indicate which instruction words have been omitted from the orderedsequence.

Clause 5. The method according to clause 4, wherein setting one or morebits to indicate which instruction words have been omitted from theordered sequence comprises: setting a plurality of bits in a mask toindicate which instruction words have been omitted from the orderedsequence.

Clause 6. The method according to clause 4, wherein setting one or morebits to indicate which instruction words have been omitted from theordered sequence comprises: setting an end bit in an instruction word ifall following instruction words in the ordered sequence comprise bitswhich have values which match their predicted values, and wherein thecompressed version of the instruction comprises only those instructionwords from the sequence prior to the instruction word in which the endbit was set and the instruction word in which the end bit was set.

Clause 7. The method according to any of the preceding clauses, whereinre-ordering and grouping bits in the received instruction into aplurality of instruction words according to an encoding type to generatean ordered sequence of instruction words comprises: accessing mappingdata according to the encoding type; and re-ordering and grouping bitsin the received instruction using the accessed mapping data to generatean ordered sequence of instruction words.

Clause 8. The method according to any of the preceding clauses, furthercomprising: accessing the predicted values for bits in the orderedsequence of instruction words according to the encoding type.

Clause 9. The method according to any of the preceding clauses, furthercomprising receiving an identifier for the encoding type.

Clause 10. The method according to any of the preceding clauses, whereinthe encoding type corresponds to a type of ALU on which the instructionwill be executed.

Clause 11. The method according to any of the preceding clauses, whereinthe received instruction is a compiled instruction.

Clause 12. The method according to clause 11, wherein the method isimplemented by a compiler or assembler following generation of acompiled instruction.

Clause 13. The method according to any of clauses 1-11, wherein themethod is implemented when loading a program into processor memory.

Clause 14. The method according to any of the preceding clauses, whereinthe method is implemented by a processor executing device-executableinstructions stored in memory.

Clause 15. A device for encoding instructions from an instruction set,the device comprising: a processor; and a memory arranged to storedevice-executable instructions configured, when executed by theprocessor, to cause the processor, in response to receiving aninstruction from an instruction set, to: re-order and group bits in thereceived instruction into a plurality of instruction words according toan encoding type to generate an ordered sequence of instruction words;compare bit values in one or more of the instruction words in theordered sequence to their corresponding predicted values, wherein thepredicted values are generated using empirical and/or simulation data;generate a compressed version of the instruction by omitting one or moreof the instruction words in the ordered sequence based on the comparisonbetween the bit values in one or more of the instruction words in theordered sequence and their corresponding predicted values; and outputthe compressed version of the instruction.

Clause 16. A method of decoding instructions comprising: receiving, in adecode stage of a processor, one or more fetched instruction words;determining an encoding type from one or more of the fetched instructionwords; generating an ordered sequence of instruction words by selecting,for each of the instruction words in the sequence, either a fetchedinstruction word or a predicted instruction word, wherein the predictedinstruction words are generated using empirical and/or simulation data;concatenating the instruction words in the ordered sequence to form anencoded instruction and re-ordering bits in the encoded instructionaccording to the encoding type to generate a decoded instruction; andoutputting the decoded instruction.

Clause 17. The method according to clause 16, further comprising:fetching, in a fetch stage of a processor, one or more instruction wordsfrom memory.

Clause 18. The method according to clause 17, wherein the one or morefetched instruction words comprises a pre-defined number of instructionwords.

Clause 19. The method according to clause 17, wherein fetching one ormore instructions from memory comprises: fetching one or more controlbits from a plurality of instruction words; determining a number ofinstruction words to fetch based on the fetched control bits; andfetching the number of instruction words.

Clause 20. The method according to any of clauses 16-19, furthercomprising: removing one or more control bits from the fetchedinstruction words prior to generating the ordered sequence ofinstruction words.

Clause 21. The method according to clause 20, wherein removing one ormore control bits from the fetched instruction words prior to generatingthe ordered sequence of instruction words comprises: removing anycontrol bits from the fetched instruction words prior to generating theordered sequence of instruction words.

Clause 22. The method according to any of clauses 16-21, wherein the oneor more fetched instruction words comprises an ordered sequence offetched instruction words and generating an ordered sequence ofinstruction words by selecting, for each of the instruction words in thesequence, either a fetched instruction word or a predicted instructionword comprises: selecting, for each of the instruction words in thesequence, either a corresponding fetched instruction word or acorresponding predicted instruction word.

Clause 23. The method according to clause 22, wherein each fetchedinstruction word comprises one or more control bits and wherein theselection of the fetched instruction word or a corresponding predictedinstruction word is based on values of one or more of the control bitsin any prior fetched instruction words in the ordered sequence.

Clause 24. The method according to any of clauses 16-21, wherein the oneor more fetched instruction words comprises an ordered sequence offetched instruction words and generating an ordered sequence ofinstruction words by selecting, for each of the instruction words in thesequence, either a fetched instruction word or a predicted instructionword comprises: selecting, for each of the instruction words in thesequence, either a next fetched instruction word in the ordered sequenceof fetched instruction words or a corresponding predicted instructionword.

Clause 25. The method according to clause 24, wherein the selection ofeither a next fetched instruction word in the ordered sequence offetched instruction words or a corresponding predicted instruction wordis made based upon a value of a bit in a mask identified based on theencoding type.

Clause 26. The method according to any of clauses 16-25, whereinre-ordering bits in the encoded instruction according to the encodingtype to generate a decoded instruction comprises: re-ordering bits inthe encoded instruction based on mapping data identified based on theencoding type.

Clause 27. The method according to any of clauses 16-26, whereindetermining an encoding type from one or more of the fetched instructionwords comprises: determining an encoding type from one or more controlbits in a first of the fetched instruction words.

Clause 28. The method according to any of clauses 16-27, wherein theencoding type corresponds to a type of ALU on which the instruction willbe executed.

Clause 29. Decoding hardware comprising: an input arranged to receiveone or more fetched instruction words; hardware logic configured todetermine an encoding type from one or more of the fetched instructionwords; word selection logic configured to generate an ordered sequenceof instruction words by selecting, for each of the instruction words inthe sequence, either a fetched instruction word or a predictedinstruction word, wherein the predicted instruction words are generatedusing empirical and/or simulation data, and to concatenate theinstruction words in the ordered sequence to form an encodedinstruction; re-order hardware logic configured to re-order bits in theencoded instruction according to the encoding type to generate a decodedinstruction; and an output arranged to output the decoded instruction.

Clause 30. The decoding hardware according to clause 29, wherein theword selection logic is further configured to remove one or more controlbits from the fetched instruction words prior to generating the orderedsequence of instruction words.

Clause 31. The decoding hardware according to clause 29, wherein theword selection logic is further configured to remove any control bitsfrom the fetched instruction words prior to generating the orderedsequence of instruction words.

Clause 32. The decoding hardware according to any of clauses 29-31,wherein the one or more fetched instruction words comprises an orderedsequence of fetched instruction words and the word selection logic isconfigured to generate an ordered sequence of instruction words byselecting, for each of the instruction words in the sequence, either acorresponding fetched instruction word or a corresponding predictedinstruction word.

Clause 33. The decoding hardware according to clause 32, wherein eachfetched instruction word comprises one or more control bits and whereinthe word selection logic is configured to perform the selection of thefetched instruction word or a corresponding predicted instruction wordbased on values of one or more of the control bits in any prior fetchedinstruction words in the ordered sequence.

Clause 34. The decoding hardware according to any of clauses 29-31,wherein the one or more fetched instruction words comprises an orderedsequence of fetched instruction words and the word selection logic isconfigured to generate an ordered sequence of instruction words byselecting, for each of the instruction words in the sequence, either anext corresponding fetched instruction word or a corresponding predictedinstruction word.

Clause 35. The decoding hardware according to clause 34, wherein theword selection logic is configured to perform the selection of either anext fetched instruction word in the ordered sequence of fetchedinstruction words or a corresponding predicted instruction word basedupon a value of a bit in a mask identified based on the encoding type.

Clause 36. The decoding hardware according to any of clauses 29-35,wherein the re-order hardware logic is configured to re-order bits inthe encoded instruction according to the encoding type to generate adecoded instruction by re-ordering bits in the encoded instruction basedon mapping data identified based on the encoding type.

Clause 37. The decoding hardware according to any of clauses 29-36,wherein the hardware logic configured to determine an encoding type isarranged to determine an encoding type from one or more control bits ina first of the fetched instruction words.

Clause 38. The decoding hardware according to any of clauses 29-37,wherein the encoding type corresponds to a type of ALU on which theinstruction will be executed.

Clause 39. A processor comprising a decode stage, wherein the decodestage comprises decoding hardware according to any of clauses 29-38.

Clause 40. The processor according to clause 39, further comprising afetch stage configured to fetch one or more instruction words frommemory.

Clause 41. The processor according to clause 40, wherein the one or morefetched instruction words comprises a pre-defined number of instructionwords.

Clause 42. The processor according to clause 40, wherein the fetch stageis configured to fetch one or more control bits from a plurality ofinstruction words; determine a number of instruction words to fetchbased on the fetched control bits; and fetch the number of instructionwords.

Clause 43. A device for decoding instructions from an instruction set,the device comprising: a processor; and a memory arranged to storedevice-executable instructions configured, when executed by theprocessor, to cause the processor, in response to receiving one or morefetched instruction words, to: determine an encoding type from one ormore of the fetched instruction words; generate an ordered sequence ofinstruction words by selecting, for each of the instruction words in thesequence, either a fetched instruction word or a predicted instructionword, wherein the predicted instruction words are generated usingempirical and/or simulation data; concatenate the instruction words inthe ordered sequence to form an encoded instruction and re-ordering bitsin the encoded instruction according to the encoding type to generate adecoded instruction; and output the decoded instruction.

Clause 44. A method of manufacturing, using an integrated circuitmanufacturing system, decoding hardware as claimed in any of clauses29-38.

Clause 45. An integrated circuit definition dataset that, when processedin an integrated circuit manufacturing system, configures the integratedcircuit manufacturing system to manufacture decoding hardware as claimedin any of clauses 29-38.

Clause 46. A computer readable storage medium having stored thereon acomputer readable description of an integrated circuit that, whenprocessed in an integrated circuit manufacturing system, causes theintegrated circuit manufacturing system to manufacture decoding hardwareas claimed in any of clauses 29-38.

Clause 47. An integrated circuit manufacturing system configured tomanufacture decoding hardware as claimed in any of clauses 29-38.

Clause 48. An integrated circuit manufacturing system comprising: anon-transitory computer readable storage medium having stored thereon acomputer readable description of an integrated circuit that describesdecoding hardware; a layout processing system configured to process theintegrated circuit description so as to generate a circuit layoutdescription of an integrated circuit embodying the decoding hardware;and an integrated circuit generation system configured to manufacturethe decoding hardware according to the circuit layout description,wherein the decoding hardware comprises: an input arranged to receiveone or more fetched instruction words; hardware logic configured todetermine an encoding type from one or more of the fetched instructionwords; word selection logic configured to generate an ordered sequenceof instruction words by selecting, for each of the instruction words inthe sequence, either a fetched instruction word or a predictedinstruction word, wherein the predicted instruction words are generatedusing empirical and/or simulation data, and to concatenate theinstruction words in the ordered sequence to form an encodedinstruction; re-order hardware logic configured to re-order bits in theencoded instruction according to the encoding type to generate a decodedinstruction; and an output arranged to output the decoded instruction.

Clause 49. A method comprising: receiving, at an input, mapping data foran instruction set and instruction data describing instructions in aninstruction set in canonical form; parsing the mapping data andinstruction data using a grammar library; generating, in a code and datageneration engine, both encoding software and a hardware description ofa decoder based on the parsed mapping data and instruction data; andoutputting the encoding software and the hardware description of adecoder.

Clause 50. The method according to clause 49, further comprising:generating debugging data and documentation in human-readable form inthe code and data generation engine and based on the parsed mapping dataand instruction data; and outputting the debugging data anddocumentation in human-readable form.

Clause 51. A device comprising: a processor; and a memory arranged tostore device-executable instructions configured, when executed by theprocessor, to cause the processor, in response to receiving mapping datafor an instruction set and instruction data describing instructions inan instruction set in canonical form, to: parse the mapping data andinstruction data using a grammar library; generate both encodingsoftware and a hardware description of a decoder based on the parsedmapping data and instruction data; and output the encoding software andthe hardware description of a decoder.

Clause 52. A processor configured to perform the method of any ofclauses 1-14, 16-28 and 49-50.

Clause 53. Computer readable code configured to cause the method of anyof clauses 1-14, 16-28 and 49-50 to be performed when the code is run.

Clause 54. A computer readable storage medium having encoded thereon thecomputer readable code of clause 53.

Those skilled in the art will realize that storage devices utilized tostore program instructions can be distributed across a network. Forexample, a remote computer may store an example of the process describedas software. A local or terminal computer may access the remote computerand download a part or all of the software to run the program.Alternatively, the local computer may download pieces of the software asneeded, or execute some software instructions at the local terminal andsome at the remote computer (or computer network). Those skilled in theart will also realize that by utilizing conventional techniques known tothose skilled in the art that all, or a portion of the softwareinstructions may be carried out by a dedicated circuit, such as a DSP,programmable logic array, or the like.

The methods described herein may be performed by a computer configuredwith software in machine readable form stored on a tangible storagemedium e.g. in the form of a computer program comprising computerreadable program code for configuring a computer to perform theconstituent portions of described methods or in the form of a computerprogram comprising computer program code means adapted to perform allthe steps of any of the methods described herein when the program is runon a computer and where the computer program may be embodied on acomputer readable storage medium. Examples of tangible (ornon-transitory) storage media include disks, thumb drives, memory cardsetc. and do not include propagated signals. The software can be suitablefor execution on a parallel processor or a serial processor such thatthe method steps may be carried out in any suitable order, orsimultaneously.

The hardware components described herein may be generated by anon-transitory computer readable storage medium having encoded thereoncomputer readable program code.

Memories storing machine executable data for use in implementingdisclosed aspects can be non-transitory media. Non-transitory media canbe volatile or non-volatile. Examples of volatile non-transitory mediainclude semiconductor-based memory, such as SRAM or DRAM. Examples oftechnologies that can be used to implement non-volatile memory includeoptical and magnetic memory technologies, flash memory, phase changememory, resistive RAM.

A particular reference to “logic” refers to structure that performs afunction or functions. An example of logic includes circuitry that isarranged to perform those function(s). For example, such circuitry mayinclude transistors and/or other hardware elements available in amanufacturing process. Such transistors and/or other elements may beused to form circuitry or structures that implement and/or containmemory, such as registers, flip flops, or latches, logical operators,such as Boolean operations, mathematical operators, such as adders,multipliers, or shifters, and interconnect, by way of example. Suchelements may be provided as custom circuits or standard cell libraries,macros, or at other levels of abstraction. Such elements may beinterconnected in a specific arrangement. Logic may include circuitrythat is fixed function and circuitry can be programmed to perform afunction or functions; such programming may be provided from a firmwareor software update or control mechanism. Logic identified to perform onefunction may also include logic that implements a constituent functionor sub-process. In an example, hardware logic has circuitry thatimplements a fixed function operation, or operations, state machine orprocess.

Any range or device value given herein may be extended or alteredwithout losing the effect sought, as will be apparent to the skilledperson.

It will be understood that the benefits and advantages described abovemay relate to one embodiment or may relate to several embodiments. Theembodiments are not limited to those that solve any or all of the statedproblems or those that have any or all of the stated benefits andadvantages.

Any reference to ‘an’ item refers to one or more of those items. Theterm ‘comprising’ is used herein to mean including the method blocks orelements identified, but that such blocks or elements do not comprise anexclusive list and an apparatus may contain additional blocks orelements and a method may contain additional operations or elements.Furthermore, the blocks, elements and operations are themselves notimpliedly closed.

The steps of the methods described herein may be carried out in anysuitable order, or simultaneously where appropriate. The arrows betweenboxes in the figures show one example sequence of method steps but arenot intended to exclude other sequences or the performance of multiplesteps in parallel. Additionally, individual blocks may be deleted fromany of the methods without departing from the spirit and scope of thesubject matter described herein. Aspects of any of the examplesdescribed above may be combined with aspects of any of the otherexamples described to form further examples without losing the effectsought. Where elements of the figures are shown connected by arrows, itwill be appreciated that these arrows show just one example flow ofcommunications (including data and control messages) between elements.The flow between elements may be in either direction or in bothdirections.

The applicant hereby discloses in isolation each individual featuredescribed herein and any combination of two or more such features, tothe extent that such features or combinations are capable of beingcarried out based on the present specification as a whole in the lightof the common general knowledge of a person skilled in the art,irrespective of whether such features or combinations of features solveany problems disclosed herein. In view of the foregoing description itwill be evident to a person skilled in the art that variousmodifications may be made within the scope of the invention.

What is claimed is:
 1. Decoding hardware comprising: an input arrangedto receive one or more fetched instruction words; hardware logicconfigured to determine an encoding type from one or more of the fetchedinstruction words; word selection logic configured to generate anordered sequence of instruction words by selecting, for each of theinstruction words in the sequence, either a fetched instruction word ora predicted instruction word, wherein the predicted instruction wordsare generated using empirical and/or simulation data, and to concatenatethe instruction words in the ordered sequence to form an encodedinstruction; re-order hardware logic configured to re-order bits in theencoded instruction according to the encoding type to generate a decodedinstruction; and an output arranged to output the decoded instruction.2. The decoding hardware according to claim 1, wherein the wordselection logic is further configured to remove one or more control bitsfrom the fetched instruction words prior to generating the orderedsequence of instruction words.
 3. The decoding hardware according toclaim 1, wherein the word selection logic is further configured toremove any control bits from the fetched instruction words prior togenerating the ordered sequence of instruction words.
 4. The decodinghardware according to claim 1, wherein the one or more fetchedinstruction words comprises an ordered sequence of fetched instructionwords and the word selection logic is configured to generate an orderedsequence of instruction words by selecting, for each of the instructionwords in the sequence, either a corresponding fetched instruction wordor a corresponding predicted instruction word.
 5. The decoding hardwareaccording to claim 4, wherein each fetched instruction word comprisesone or more control bits and wherein the word selection logic isconfigured to perform the selection of the fetched instruction word or acorresponding predicted instruction word based on values of one or moreof the control bits in any prior fetched instruction words in theordered sequence.
 6. The decoding hardware according to claim 1, whereinthe one or more fetched instruction words comprises an ordered sequenceof fetched instruction words and the word selection logic is configuredto generate an ordered sequence of instruction words by selecting, foreach of the instruction words in the sequence, either a nextcorresponding fetched instruction word or a corresponding predictedinstruction word.
 7. The decoding hardware according to claim 6, whereinthe word selection logic is configured to perform the selection ofeither a next fetched instruction word in the ordered sequence offetched instruction words or a corresponding predicted instruction wordbased upon a value of a bit in a mask identified based on the encodingtype.
 8. The decoding hardware according to claim 1, wherein there-order hardware logic is configured to re-order bits in the encodedinstruction according to the encoding type to generate a decodedinstruction by re-ordering bits in the encoded instruction based onmapping data identified based on the encoding type.
 9. The decodinghardware according to claim 1, wherein the hardware logic configured todetermine an encoding type is arranged to determine an encoding typefrom one or more control bits in a first of the fetched instructionwords.
 10. The decoding hardware according to claim 1, wherein theencoding type corresponds to a type of ALU on which the instruction willbe executed.
 11. A method of decoding instructions comprising:receiving, in a decode stage of a processor, one or more fetchedinstruction words; determining an encoding type from one or more of thefetched instruction words; generating an ordered sequence of instructionwords by selecting, for each of the instruction words in the sequence,either a fetched instruction word or a predicted instruction word,wherein the predicted instruction words are generated using empiricaland/or simulation data; concatenating the instruction words in theordered sequence to form an encoded instruction and re-ordering bits inthe encoded instruction according to the encoding type to generate adecoded instruction; and outputting the decoded instruction.
 12. Themethod according to claim 11, further comprising: fetching, in a fetchstage of a processor, one or more instruction words from memory.
 13. Themethod according to claim 12, wherein the one or more fetchedinstruction words comprises a pre-defined number of instruction words.14. The method according to claim 12, wherein fetching one or moreinstructions from memory comprises: fetching one or more control bitsfrom a plurality of instruction words; determining a number ofinstruction words to fetch based on the fetched control bits; andfetching the number of instruction words.
 15. A method of encodinginstructions from an instruction set, the method comprising: receivingan instruction from the instruction set; re-ordering and grouping bitsin the received instruction into a plurality of instruction wordsaccording to an encoding type to generate an ordered sequence ofinstruction words; comparing bit values in one or more of theinstruction words in the ordered sequence to their correspondingpredicted values and generating a compressed version of the instructionby omitting one or more of the instruction words in the ordered sequencebased on the comparison, wherein the predicted values are generatedusing empirical and/or simulation data; and outputting the compressedversion of the instruction.
 16. The method according to claim 15,wherein the compressed versions of different groups of instructionswithin the instruction set comprise different numbers of instructionwords.
 17. The method according to claim 15, wherein generating acompressed version of the instruction comprises: omitting one or moreinstruction words from the ordered sequence that only comprise bits thathave values that match the predicted values for those bits; andoptionally wherein, generating a compressed version of the instructionfurther comprises: setting one or more bits to indicate whichinstruction words have been omitted from the ordered sequence.
 18. Anintegrated circuit manufacturing system comprising: a non-transitorycomputer readable storage medium having stored thereon a computerreadable description of an integrated circuit that describes decodinghardware according to claim 1; a layout processing system configured toprocess the integrated circuit description so as to generate a circuitlayout description of an integrated circuit embodying the decodinghardware; and an integrated circuit generation system configured tomanufacture the decoding hardware according to the circuit layoutdescription.
 19. A method comprising: receiving, at an input, mappingdata for an instruction set and instruction data describing instructionsin an instruction set in canonical form; parsing the mapping data andinstruction data using a grammar library; generating, in a code and datageneration engine, both encoding software and a hardware description ofa decoder based on the parsed mapping data and instruction data, whereinthe decoder comprises decoding hardware according to claim 1; andoutputting the encoding software and the hardware description of adecoder.
 20. The method according to claim 19, further comprising:generating debugging data and documentation in human-readable form inthe code and data generation engine and based on the parsed mapping dataand instruction data; and outputting the debugging data anddocumentation in human-readable form.